Entropy computations via analytic depoissonization
نویسندگان
چکیده
منابع مشابه
Entropy Computations via Analytic Depoissonization
Wojciech Szpankowskit Department of Computer Science Purdue University W. Lafayette, IN 47907 UB.A. [email protected] We investigate the basic question of information theory, namely, evaluation of Shannon entropy, and a more general Renyi entropy, for some discrete distributions (e.g., binomial, negative binomial, etc.). We aim at establishing analytic methods (Le., those in which complex analy...
متن کاملMaking Maximum Entropy Computations Easier
This paper presents a new way to compute the probability distribution with maximum entropy satisfying a set of constraints. Unlike previous approaches , our method is integrated with the planning of data collection and tabulation. We show how adding constraints and performing the associated additional tabulations can substantially speed up computation by replacing the usual iterative techniques...
متن کاملMaximum Entropy and Interval Computations
Because these fields are closely related, and since this relation is not yet a common knowledge, I would like it to be known to the interval community. Yes, terms that we use are different, and mathematical methods are different, but these different methods are used to solve the same application problems. In solving these problems, interval and maximum entropy methods not only do not compete, t...
متن کاملAnalytical Depoissonization and its Applications
Wojciech Szpankowskit Department of Computer Science Purdue University W. Lafayette, IN 47907 U.S.A. [email protected] In combinatorics and analysis of algorithms often a Poisson version of a problem (called further Poisson model or poissonization) is easier to solve than the original one, which we name here as the Bernoulli model. Poissonization is a technique that replaces the original input ...
متن کاملThe energy and entropy of VLSI computations
We introduce the concept of energy index, a measure which can be used to estimate the power dissi-pation of a standard implementation of the high-level speciication for an asynchronous circuit. This energy index is related to information-theoretic entropy measures. It is shown how these measures can be used to design low-power circuits.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 1999
ISSN: 0018-9448
DOI: 10.1109/18.761251